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I. INTRODUCTION 



Even though the Standard Model with three fermion families (SM3) accounts for almost 

n 

all of the large amount of the particle physics phenomena |1|, there are a number of fun- 
damental problems which cannot be addressed in the framework of the SM3: quark-lepton 
symmetry, fermion's mass and mixing pattern, family replication and the number of fami- 
lies, L-R symmetry breaking, electroweak scale etc. In addition, SM3 contains unacceptably 
large number of arbitrary free parameters put by hand: 19 if the neutrinos are massless, 26 
if neutrinos are Dirac particles and more than 30 if neutrinos are Majorana particles. Flavor 
Democracy Hypothesis (FDH), which is quite natural in respect to the SM basics, provides 
a partial solutions to the above-mentioned problems, namely: sheds light on fermion's mass 
and mixing pattern, implies the number of SM families to be 4 and reduces the number of 
free parameters ^2 4 1 (see also reviews 10 1 and references therein). 

Historical analogy: Let us emphasize the analogy of today's SM fermions and parameters 
inflation with chemical elements inflation in 19th century and hadron inflation in 1950 — 1960. 
The both cases have been clarified through four stages: systematics, predictions confirmed, 
clarifying experiments, new basic physics level (see Table I) . We have added the last row to 
the Table in order to reflect present situation in particle physics. 

Let us remind that flavour physics met a lot of surprises. The first example was discovery 
of /i-meson (We were looking for 7r-meson predicted by Yukawa but discovered the "heavy 
electron"). The next example was represented by strange particles (later we understood 
that they contains strange quarks). The story was followed by r-lepton, c- and b-quarks 
discovered in 1970's. Actually, c-quark was foreseen by GIM mechanism and quark-lepton 
symmetry and its mass was estimated in the few GeV region, whereas the discovery of r- 
lepton and b-quark was completely surprising for physicists. According to the Standard 
Model they are the members of the third fermion family, which was completed by the 
discovery of t-quark in 1995 at Tevatron. Actually, we need at least three fermion families 
in order to handle CP-violation within the SM CP violation is necessary for the 

explanation of Barion Asymmetry of the Universe (BAU). Unfortunately, SM with three 
fermion families does not provide actual magnitude for BAU. Fortunately, the fourth SM 
amily could provide additional factor of order of 10 10 and, therefore, solves the problem 



12|. 
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Inflation 


Systematic 


Confirmed 
Predictions 


Clarifying 
experiments 


Fundamentals 


Chemical Elements 


Mendeleyev Periodic Table 


New elements 


Rutherford 


P, n, e 


Hadrons 


Eight-fold Way 


New hadrons 


SLAC DIS 


quarks 


SM fermions 


Flavor Democracy 


Fourth family ? 


LHC ? 


Preons ? 



Table I: Historical analogy 



The status of the fourth SM family (SM4) was clearly emphasized at dedicated inter- 

le workshop was 
13j. These state- 



national workshop held at CERN in September 2008. The outcome of t 
published in a paper titled "Four statements about the fourth generation" 
ments are: 

1. The fourth generation is not excluded by EW precision data. 

2. SM4 address some of the currently open questions. 

3. SM4 can accommodate emerging possible hints of new physics. 

4. LHC has the potential to discover or fully exclude SM4. 

In our opinion the last statement is the most important one, because, indirect manifes- 
tations could have many different explanations, the existence of the fourth SM family will 
be proved with the direct discovery of its quarks and leptons. Current experimental bounds 
on the masses of the fourth SM family fermions are as follows 

m U4 > 256 GeV, 

m d4 > 128 GeV (100% CC decays); m d4 > 199 GeV (100% NC decays), 
m h > 100.8 GeV, 

m„ 4 > 90.3 GeV (Dirac type), m U4 (light) > 80.5 GeV (Majorona type). 

By this time almost all papers on the SM4 searches consider only SM decay modes. 
However, it is possible that anomalous decay modes could be dominant, if some criteria is 
met [l-jj . In this case, the search strategy should be changed drastically and current low 
limits from Tevatron experiments are not valid. 

The scope of the paper is following: in Section 2 we give a brief review of the Flavor 
Democracy Hypothesis and discuss possible manifestations of the fourth SM family at ex- 
isting and future colliders. Then, we concentrate on the scenario with dominance of the 
anomalous decay modes of the fourth family quarks. The criteria for this dominance are 
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considered in Section 3. In Section 4 we consider pair production at the Tevatron and LHC 
with subsequent anomalous decays. Section 5 is devoted to investigation of anomalous res- 
onant production of the fourth family quarks with subsequent anomalous decays. Finally, 
in Section 6 we present concluding remarks and recommendations. 



II. WHY THE FOUR SM FAMILIES ? 



First of all, the number of fermion families is not fixed by the SM. But the asymptotic 
freedom restricts this number from above, namely, N < 8. Then, the number of SM families 
with "massless" neutrinos (which means m v < rriz/2) is determined to be equal to 3 by the 
LEP1 data. Therefore, number of families could be any number between 3 and 8, inclusively. 
The most of the free parameters (put by hand) in the SM comes from the Yukawa interactions 
between the SM fermions and the Higgs doublet, which provides fermion masses and mixings 
through Spontaneous Symmetry Breaking (SSB). It should be noted that before the SSB, 
fermions with the same quantum numbers are indistinguishable. Naturally, all Yukawa 
coupling constants for indistinguishable fermions should be the same. This is the first 
assumption of the Flavor Democracy Hypothesis. If there is only one Higgs doublet all 
fundamental fermions (up and down type quarks, charged leptons and neutrinos) should 
have the same Yukawa coupling constants, since all fermions interact with the same Higgs 
field. This is the second assumption of the FDH. After the SSB these assumptions in the 
case of N SM families result with N — 1 fermion families to be massless and the N'th family 
to be heavy and degenerate. By taking into consideration masses of the third SM family, the 
FDH implies at least the existence of the fourth SM family 2|-|4j. In this case, the masses of 
the first three family fermions come from the slight violation of the full democrac y [15 

There are two arguments against the existence of the fifth SM family 
first one is the large value of the t-quark mass: in the case of 5 SM families the FDH 
gives m t « « m^,, but it contradicts to partial- wave unitarity constraint vtlq < 700 
GeV ~ 4 m t . The second argument is the neutrino counting at the LEP1: data gives three 
"massless" non-sterile neutrinos, whereas in the case of the five SM families the FDH predicts 
this number to be four. 

The main reason why the HEP community has objected against the fourth SM family 
so far comes from the incorrect interpretation of the electroweak precision data. This inter- 
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pretation since 1990's has been included into PDG reports published bi-annually in leading 



HEP journals. It should be noted that recent opinion 



18] of the writers of the corresponding 



part of PDG reports is not as strict as it was. Actually in a number of papers published 



during the last decade 
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- |27| it has been shown that the precision data and the SM4 are 
not mutually exclusive. It is interesting that the updated precision data is shifted into the 
direction of SM4 predictions. For the investigation of the compatibility of the precision data 
with the fourth SM family and other physics beyond the SM3 a new code named OPUCEM 
has been developed very recently. Using this code we determined the validity of 
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SM4 with a given set of parameters, namely, m Ui = 410 GeV, m^ 4 = 390 GeV, S34 = 0.01 
(CKM mixing between fourth and third SM family quarks), m V4 (/) = 105 GeV for light 
Majorana neutrino, m^ 4 = 450 GeV, m# = 290 GeV and m V4 (/i) = 2300 GeV for heavy 
Majorana neutrino. This set is favored by FDH if the common Yukawa coupling for all SM4 
fermions is equal to the SUw{2) gauge constant g\y (m^ = 290 GeV corresponds to quartic 
coupling of Higgs field equal to gw)- Result is R = 0.97 which is two times better than SM3 
value R — 1.7 (here R = Ay 2 denotes the "distance" from the central values of 5* and T 



parameters, for details see |27l |28|). 

Actually, there is an infinite number of SM4 points (analog of the well known SUGRA 
points) which are in better agreemnet with precision EW data than the SM3. In Table II we 
present three of them. In Figure 1 we present these points in S-T plane together with SM3 
predictions. It is seen that SM4 points are closer to central values of S and T parameters. 

A. Indirect manifestations 

The existence of the fourth SM family could lead to a number of different manifestations 



13| . such as essential contribution to the baryon asymmetry of the Universe (SM3 case does 
not provide enough amount of CP violation), explanation for a 2.5a deviation from SM3 
predictions on B-meson decays observed by Tevatron and B-factories etc. It should be noted 
that these are not a validation, but just an indication of the fourth SM family, since there are 
a lot of models (including SUSY) which potentially could lead to the same manifestations. 
However, the essential enhancement (from 9 times at m# « 150 GeV to 4 times m# « 500 



GeV) of Higgs boson production via gluon-gluon fusion at hadron colliders |29l-l37| could not 



be provided by other models. This enhancement could give to Tevatron an opportunity to 
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440 
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390 


390 




mi 4 , GeV 


450 


390 


390 




m^ 4 (L),GeV 


105 


91 


95 




m„ 4 (H), GeV 


2300 


2900 


2900 




ran, GeV 


290 


250 


115 


115 


S34 


0.01 


0.02 


0.02 




R 


0.97 


0.56 


0.036 


1.7 


S 


0.17 


0.15 


0.09 





T 


0.19 


0.16 


0.12 






Table II: S, T and R parameters for there SM4 points and SM3. 

projects.hepforge.org/opucem/ 

h 0.4 



0.3 



0.2 



0.1 



-0.1 




LEP EWWG Summer'09, CL 63.27% 
LEP EWWG Summer'09, CL 95.45% 
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Figure 1: SM3 and three SM4 points in S-T plane. The 1 and 2a error ellipses represent the 2009 
results of the U = fit from LEP EWWG. Black crucifix corresponds to SM3 with mu = 115 GeV; 
green, red and blue crucifixes correspond to SM4 points 1, 2 and 3 from Table 2, respectively. 



discover Higgs boson before the LHC 
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37| . Very recent combined results of CDF (with 
4.8 fb" 1 ) and DO (with 5.4 fb~ l ) searches for a standard model Higgs boson in the process 
gg -> H -»■ W + W~ exclude 131 GeV < m H < 204 GeV region in the SM4 case |jiS|. This 
excluded region will be essentially enlarged with the accumulated luminosity, or Higgs boson 
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L, 10 32 cm~ 2 s- 1 


L int {2Q\2),fb' 1 
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ep,yp 
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ILC 1 
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ILC 2 


e~e + , ye, 77 


0.8 


100 




CLIC 1 


e~e + , ye, 77 


0.5 


100 




CLIC 2 


e~e + , ye, 77 


1 


100 




CLIC 3 


e~e + , ye, yy 
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100 




Muon collider 




4 
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Table III: Parameters of existing and planned TeV scale colliders 



will be observed at Tevatron if it has appropriate mass. Moreover, simultaneous discovery 
of both the Higgs boson and the fourth family neutrino is probable at early stages of LHC 



operation or at the Tevatron 
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4l|- 



B. Direct manifestations 



Obviously, the discovery of the fourth SM family may be only provided by their production 
and observation at high energy colliders. The fourth family quarks will be copiously produced 
in pairs at the LHC p, [30_|, |44j when the designed center of mass energy and luminosity values 
is achieved. However, Tevatron still has a chance to observe U4 before the LHC if 114 mass 
is less than 425 GeV (current low limit is 340 GeV from CDF with 4.6 fb~ l ). If the fourth 
family quarks mix dominantly with first two families, M4 and quarks will give the same 
signature and observation limit will be extended to 450 GeV. 



In Table III we present the center o 



planned TeV scale colliders (see 



mass energies and luminosity values of exsisting and 
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43| and refs therein). Observational possibilities 
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? 
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Table IV: Production of the fourth SM family fermions at existing and planned high energy collid- 
ers. Abbreviations are: P (Pair production), AP (Associate Pair production), S (Single production 
through CKM mixings), A (production through Anomalous interactions), KA (Kinematically Al- 
lowed), Res (Resonant production), G (Good), VG (Very Good). Vm denotes corresponding CKM 
matrix elements, A denotes scale of anomalous interactions. 



for fourth SM family fermions at these colliders are presented in Tables IV and V. The 
direct production of the fourth SM family quarks and leptons at TeV scale colliders, namely, 



Tevatron, LHC, QCD Explorer, Linac-LHC Energy Fron 



have been considered in a number of papers 



45-61 



;ier, ILC, CLIC and muon collider 
64H78II (thi s list includes publications 



appeared during last decade, see also fourth family web pages 



79 



80|). In Tables VI and VII 



it is given the classification of these papers according to colliders and processes considered. 
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Table V: Notations as in Table IV. 
III. ANOMALOUS DECAY MODES 



The effective Lagrangian for anomalous magnetic type interactions of the fourth family 



quarks is given as 



53 



81 



821: 



L = Y^ e M<y^F^ + Y^gzq.a^Z^ + ^^^T^Gf + H.c (1) 

1i 1i Hi 

where F^ v , Z^ u and G^ u are the field strength tensors of the gauge bosons, is the 
anti-symmetric tensor, T a are Gell-Mann matrices, e q is electric charge of quark, g e , gz 
and g s are electromagnetic, neutral weak and strong coupling constants, respectively, gz = 
g e / cosOy/sinOy/ where 9y/ is the Weinberg angle. « 7 , Kz and K g are the strength of anomalous 
couplings with photon, Z boson and gluon, respectively. A is the cutoff scale for new physics. 
This type of gauge and Lorentz invariant effective Lagrangian have been proposed in the 
framework of composite models for interactions of excited fermions with ordinary fermions 
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[47, 48, 55] 
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Table VI: The papers considered production of the fourth SM family fermions at existing and 
planned high energy colliders. 



and gauge bosons 8jJ,]82j . For numerical calculations we implement the Lagrangian (1), as 



831. 



well as fourth family SM Lagrangian into the CalcHEP package 

The partial decay widths of for SM {u^ — >• W + q where q = d, s, b) and anomalous 
(«4 — > jq, W4 — > Zq, m 4 — > gq where q =u, c, t) modes are given below: 



|Kt 4 9| 2Q; e^n4 /— 



lQm 2 sin 2 9 



(2) 



where q w = (1 + x\ + x\x w - 2x 2 - 1x 
x q = (m q /m UA ) and x w = (m w /m UA ), 



4 +x 2 ) 



<sb — (1 "I - x w x t 2a?ty 1x\itX 



„2 ™2 \ 
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Table VII: The papers considered production of the fourth SM family fermions at existing and 
planned high eergy colliders (cont.) 



where ? z = (2 — x z — x 2 z — 4x 2 — x 2 x 2 z — Qx q x 2 z + 2x q ), ^ = + + — 2x| — 2x 2 — 2x 2 z x 2 ) 
and = (m z /m U4 ), 



I> 4 = — g-^(^) ^ (4) 



where <j 2 = (1 — 3x 2 + — x®), 
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I> 4 ->7<?) = 2 — ^ A ^ ^ 

The partial decay widths of for SM {d± — > where q — u, c, t) and anomalous 

(c?4 — > 7g, c?4 — >■ Zg, c? 4 — > where q = d, s, b) modes are given below: 

T(d A W-q) = Zli^} XwrfTo (6) 

where Xw = (1 + y\ + y\y% ~ 2y\ - 2yf v + y 2 w ), Xo = (1 + Vw + v\ ~ 2y 2 w - 2y 2 - 2y 2 v y 2 ), 
V q = (fn q /m d4 ) and y w = (m w /m d4 ), 

where Xz = (2-y z -y 2 z -Ay 2 -y 2 y 2 z -Qy q y 2 z + 2y^), X i = + Vz + V 2 q ~ 2 y 2 z ~ 2y 2 q - 2y 2 z y 2 ) 
and y z = (m z /m d4 ), 

r(rf 4 ^^) = ^^(f) 2 x 2 (8) 



where X2 = (1 - 3y 2 + 3y g - y & g ) 

r(d^ jq) = -^f^^fx, (9) 



,3 n2 



One can wonder what is the criteria for the dominance of anomalous decay modes over SM 
ones. It is seen from Eq. (6)-(9) that the anomalous decay modes of the fourth SM family 
quarks are dominant, i.e. T(d& — > gq) + r(c?4 — > Zq) + T^d^ — > 75) > T(d4 — > W~q), if the 
relation (k/A) > l-2(V 2 di + V 2 di + V^J 1/2 TeV" 1 is satisfied (hereafter «| = n q g = «' = « is 
assumed). The experimental upper bounds for the fourth family quark CKM matrix elements 
are |K 4 d| < 0.063, \V U J < 0.46, \V U4b \ < 0.47, \V ud4 \ < 0.044, \V cd4 \ < 0.46, \V td4 \ < 0.47 
On the other hand, the predicted values of these matrix elements are expected to be 



QIC 



rather small in the framework of flavor democracy hypothesis. For example, the mass matrix 



parametrization proposed in 17J, which gives correct predictions for CKM and MNS mixing 
matrix elements through use of SM fermion mass values as input, predicts \V U4d \ = 0.0005, 
|K 4S | = 0.0011, |K 4b | = 0.0014, \V ud4 \ = 0.0002, \V cd4 \ = 0.0012, \V td4 \ = 0.0014. In 
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Figure 2: Branching ratio of 7x4 versus V Ui b graphic for (k/A) = ITeV 
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V u 4 b 

Figure 3: Branching ratio of U4 versus V U4 b graphic for (ft/A) = O.STeV" 1 

this case, the anomalous decay modes are dominant, if («/A) > 0.0022 TeV" 1 . The latter 
correspondens to upper limit 500 TeV for new physics scale A, assuming k = 0(1). 

In Figs 2-5, we plotted branching ratios of u 4 quark as a function of V UA b for different 
values of k/A. Branching ratios of U4 quarks as a function of k/A for different values of V Ui b 
are shown Figs. 6-8. It is seen that the assumption of the dominance of anomalous decay 
modes is quite realistic, especially for small CKM mixing parameters. Total decay widths 
of U4 and g?4 quarks depending on their masses were plotted in Fig 9 and 10, respectively. 



BR(u 4 ->W + b) 
BR(u 4 ->ug) 
k/A=0.3 TeV BR(u 4 ->uZ) 



BR(u 4 ->uy) 
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;ure 4: Branching ratio of U4 versus V Ui b graphic for (k/A) = O.lTeV 
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ure 5: Branching ratio of 114 versus V UA b graphic for (k/A) = 0.03Tey~ 
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Figure 6: Branching ratio of 114 versus (k/A) graphic for V U4 b = 0.4 
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Figure 7: Branching ratio of M4 versus (k/A) graphic for V Ui b = 0.1 
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Figure 8: Branching ratio of U4 versus (k/A) graphic for V U4 b = 0.03 
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Figure 9: Anomalous decay width of U4. 
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Figure 10: Anomalous decay width of d^. 

IV. PAIR d 4 PRODUCTION AT TEVATRON AND LHC WITH SUBSEQUENT 
ANOMALOUS DECAYS 

In this section, we study pair production of <i 4 quarks at the Tevatron and LHC. For the 
numerical calculations we implement anomalous interaction lagrangian of the fourth family 
quarks into CalcHEP package program 



83] and we used CTEQ6L |84| parton distribution 
functions with factorization scale Q 2 = m 2 dA . The pair production cross sections of d±d\ at 
the Tevatron and LHC are plotted in Fig. 11. It is seen that i.e. for = 300 GeV pair 
production cross section at LHC with y/s = 7 TeV is 20 times larger than at Tevatron. This 
ratio can be used to compaire Tevatron and LHC capacities. Namely, for = 300 GeV 
LHC need twenty times less luminosity than the Tevatron. 

Pair production of fourth SM family quarks at hadron colliders have been analysed in 
a number of papers (see corresponding rows in the Table VI ) assuming SM decays. For 
this reason below we consider the process pp(p) — > d^d^X — > gd'-fdX in order to compare 
the Tevatron and LHC search potential in the case where anomalous decays are dominant. 
This process will be seen in dedector as 7 + 3j events, for background calculations we use 
MADGRAPH package |s5|. 
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Figure 11: The pair production cross section of 0(4^4 at the Tevatron and LHC 
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Figure 12: Normalised px distributions of partons for signal and background for pair d± production 
at the Tevatron. 

A. Signal and Background Analysis at the Tevatron 

Normalized transverse momentum (jpx) and pseudo-rapidity (77) distributions of final state 
partons (quarks, photon and gluon) for signal and background processes are shown in Fig. 
12 and Fig. 13, respectively. It is seen that p? > 50 GeV cut essentially reduces background, 
whereas signal is almost unaffected. In addition to px > 50 GeV, we have used CDF cut 
value 1 77 1 < 2 for pseudo-rapidity, as well as invariant mass within ±20 GeV around mass. 
In table VIII we present the values of the signal and background cross-sections for different 
cuts. 



Tevatron (Vs=1 .96 TeV) 
LHC (Vs=7 TeV) 
LHC (Vs=1 TeV) 
LHC (Vs=14TeV) 
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Figure 13: Normalized 77 distributions of partons of signal and background for pair production 
at the Tevatron. 



M di 


200 GeV 


300 GeV 


400 GeV 


cuts 


a s , fb 


a B , fb 


a s , fb 


a B , fb 


a s , fb 


a B , fb 


p T > 20GeV 


39.2 


5.4 x 10 5 


2.92 


5.4 x 10 5 


0.23 


5.4 x 10 5 


p T > 50GeV 


24.5 


2.7 x 10 3 


2.40 


2.7 x 10 3 


0.21 


2.7 x 10 3 


all cuts 


21.8 


3.63 


2.27 


0.091 


0.20 


0.006 



Table VIII: Signal and background cross sections values for various cuts at Tevatron I14H . All cuts 
include p T > 50 GeV, \rj\ < 2, \M inv ( 7 j) - M di \ < 20 GeV, \M mv (jj) - M di \ < 20 GeV. 



Statistical significance has been calculated by using following formula 



86|: 



S=^2[{s + b)ln{\ + -)-s] (10) 

where s and b represents the numbers of signal and background events, respectively. 

In Fig. 14 we plot the neccesary luminosity for 2a exclusion, 3cr observation and 5a 
discovery limits depending on mass. Reachable masses for d^ quark at different values of 
the Tevatron integrated luminosity are presented in Table IX. 



B. Signal and Background Analysis at the LHC 

Normalized transverse momentum (p?) and pseudo-rapidity (77) distributions of final state 
partons (quarks, photon and gluon) for signal and background processes are shown in Fig. 
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Figure 14: The necessary integrated luminosity for exclusion, observation and discovery of quark 
at the Tevatron I14L 



Lint, fb 1 


5 


10 


20 


2a exclusion 


390 GeV 


430 GeV 


460 GeV 


3<T observation 


370 GeV 


410 GeV 


440 GeV 


5a discovery 


340 GeV 


360 GeV 


390 GeV 



Table IX: Reachable m^ 4 mass values for discovery, observation, and exclusion at the Tevatron [14| . 

15 and Fig. 16, respectively. It is seen that pt > 50 GeV cut essentially reduces background, 
whereas signal is almost unaffected. In addition to > 50 GeV, we have used ATLAS cut 
value \rj\ < 2.5 for pseudo-rapidity, as well as invariant mass within ±20 GeV around d<± 
mass. In Table X we present the values of the signal and background cross-sections for 
different cuts. 



M di 


200 GeV 


300 GeV 


400 GeV 


500 GeV 


cuts 


a s , fb 


a B , fb 


a s , fb 


a B , fb 


a s , fb 


a B , fb 


a s , fb 


a B , fb 


p T > 20 GeV 


3.77 x 10 3 


7.44 x 10 6 


394 


7.44 x 10 6 


71.1 


7.44 x 10 6 


19.2 


7.44 x 10 6 


p T > 50 GeV 


2.14 x 10 3 


1.12 x 10 5 


319 


1.12 x 10 5 


63.7 


1.12 x 10 5 


17.9 


1.12 x 10 5 


all cuts 


315 


13.62 


46.94 


1.03 


9.3 


0.59 


2.4 


0.037 



Table X: Signal and background cross sections values for various cuts at the LHC. All cuts include 
p T > 50 GeV, |r?| < 2.5, \M inv (jj) - M di \ < 20 GeV, \M inv (jj) - M d J < 20 GeV. 
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Figure 15: Normalised px distributions of partons for the signal and background for pair d& pro- 
duction at the LHC. 
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Figure 16: Normalised rj distributions of partons for the signal and background for pair d^ produc- 
tion at the LHC. 

In Fig. 17 we plot the neccesary luminosity for 2er exclusion, 3cr observation and 5a 
discovery limits depending on <i 4 mass. Reachable masses for <i 4 quark at different values of 
the Tevatron integrated luminosity are presented is Table XI. 

Comparing Tables IX and XI, one can conclude that LHC with y/s = 7 TeV and integrated 
luminosity L int = 300 p6 _1 surpasses the Tevatron with L int = 10 fb^ 1 . 
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Figure 17: The necessary integrated luminosity for exclusion, observation and discovery of quark 
at the LHC. 



Lint, pb 1 


100 


300 


1000 


2a exclusion 


420 GeV 


510 GeV 


640 GeV 


3a observation 


370 GeV 


430 GeV 


550 GeV 


5a discovery 


310 GeV 


360 GeV 


460 GeV 



Table XI: Reachable irid 4 mass values for discovery, observation, and exclusion at the LHC. 

V. ANOMALOUS RESONANT u 4 PRODUCTION AT TEVATRON AND LHC 
WITH SUBSEQUENT ANOMALOUS DECAY 

Total cross sections for the anomalous resonant production of w 4 quark at the Tevatron 
and LHC are shown in Fig. 18. It is seen that for m& A = 300 GeV the cross section at the 
LHC with yfs = 7 TeV is 40 times larger than the cross section at the Tevatron. 

A. Signal and Background Analysis at the Tevatron 

The pp — > u^X — y 7«X process is considered as a signature of anomalous resonant 
production of fourth SM family up type quark. The SM background for this process is 
pp — y 'yjX, where j = u, u, d, d, c, c, s, s, b, b, g. In order to determine appropriate kinematical 
cuts, Pt and r\ distributions for signal and background processes are given in Fig. 19 and 
Fig. 20, respectively. 
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Figure 18: The anomalous resonant production cross sections of M4 at Tevatron and LHC. 
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Figure 19: Normalised px distributions of partons for the signal and background for anomalous 
resonant U4 production at the Tevatron. 

In order to extract the U\ signal and to suppress the background, the following cuts are 
applied: > 75 GeV and \rj\ < 2 for all final state partons and photon, as well as invariant 
mass within ±20 GeV around the 114 mass. For the signal calculations k/A = O.lTeV^ 1 
have been used. 

In Fig. 21 we plot the neccesary luminosity for 2a exclusion, 3a observation and 5a 
discovery limits depending on u 4 mass. Reachable masses for u 4 quark at different values of 
the Tevatron integrated luminosity are presented in Table XII. 
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Figure 20: Normalised r\ distributions of partons for the signal and background for anomalous 
resonant M4 production at the Tevatron. 
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Figure 21: The necessary integrated luminosity for exclusion, observation and discovery of U4 quark 
at the Tevatron 



Lint, fb 1 


5 


10 


20 


2cr exclusion 


480 GeV 


560 GeV 


630 GeV 


3a observation 


400 GeV 


470 GeV 


540 GeV 


5a discovery 


270 GeV 


360 GeV 


440 GeV 



Table XII: Reachable m Ui mass values for discovery, observation and exclusion at the Tevatron 
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Figure 22: Normalised px distributions of partons for the signal and background for anomalous 
resonant 114 production at the LHC. 
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Figure 23: Normalised r\ distributions of partons for the signal and background for anomalous 
resonant production at the LHC. 

B. Signal and Background Analysis at the LHC 

In order to determine appropriate kinematical cuts, px and r\ distributions for signal and 
background processes are given in Fig. 22 and Fig. 23, respectively. 

In order to extract the M4 signal and to suppress the background, the following cuts are 
applied: pt > 75 GeV and |?7| < 2.5 for all final state partons and photon, as well as invariant 
mass within ±20 GeV around the M4 mass. For the signal calculations k/A = 0.1 TeV -1 
have been used. 
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Figure 24: The necessary integrated luminosity for exclusion, observation and discovery of U4 quark 
at the LHC 

In Fig. 24 we plot the neccesary luminosity for 2er exclusion, 3cr observation and 5a 
discovery limits depending on u\ mass. 

Comparing figures 21 and 24, it is obvious that LHC with yfs = 7 TeV and integrated 
luminosity L int = 100 p& _1 surpasses the Tevatron with L int = 10 fb~ l . 

VI. CONCULUSION 

It is seen that there is a though competition between Tevatron and LHC in a search for 
Higgs boson and fourth family quarks. We have shown that in case the anomalous decay 
modes are dominant: 

a) for pair production, LHC with yfs = 7 TeV and Li nt = 300 pb~ l surpasses Tevatron 
with L int = 10 fb~ l , 

b) for anomalous resonant production, LHC with L int = 100 pb~ l cover whole mass range 
if re/A = 0.1 TeV" 1 . 



[1] C. Amsler et al., (Particle Data Group), The Review of Particle Physics, Phys. Lett. B 667, 1 
(2008). 

[2] H. Fritzsch, Light neutrinos, non universality of the leptonic weak interaction and a fourth 
massive generation, Phys. Lett. B 289, 92 (1992). 

25 



5a 
3a 
2a 




[3] A. Datta, Flavor democracy calls for the fourth generation, Pramana 40, L503 (1993). 
[4] A. Celikel, A. Ciftci and S. Sultansoy, A Search for fourth SM family, Phys. Lett. B 342, 257 
(1995). 

[5] S. Sultansoy, Four remarks on physics at LHC, Talk given at the ATLAS Week, Geneva, 

Switzerland, 26-31, May 1997, AU-HEP-97-05, Jun 1997. 
[6] S. Sultansoy, Four ways to TeV scale, Talk given at International Workshop on Linac Ring 

Type ep and7p Colliders, Ankara, Turkey, 9-11 Apr 1997; Turk. J. Phys. 22, 575 (1998). 
[7] S. Sultansoy, Why the four SM families, Contributed to 30th International Conference on High- 



Energy Physics (ICHEP 2000), Osaka, Japan, 27 Jul-2 Aug 2000; arXiv:hep-ph/0004271 



[8] E. Arik and S. Sultansoy, Turkish comments on 'Future perspectives in HEP', BOUN-HEP- 



2003-01, GU-HEP-2003-01, Jan 2003; arXiv:hep-ph/0302012 



[9] S. Sultansoy, Flavor Democracy in Particle Physics, Invited talk at 6th International Confer- 
ence of the Balkan Physical Union, Istanbul, Turkey, 22-26 Aug 2006; AIP Conf. Proc. 899, 



49 (2007); arXiv:hep-ph/0610279 



[10] S. Sultansoy, The Naturalness of the Fourth SM Family, Talk given at International Conference 
on Particle Physics: In memoriam Engin Arik and her colleagues, Istanbul, Turkey, 27-31 Oct 
2008; Balkan Phys. Lett. 17, 353 f2009): lirXTv:0905. 28741 [hep-ph]. 

[11] M. Kobayashi and T. Maskawa, Prog. Theor. Phys. 49, 652 (1973). 

[12] W.-S. Hou, Chin. J. Phys. 47, 134 (2009). 

[13] B. Holdom et al., Four Statements about the Fourth Generation, Presented at Beyond the 3rd 
SM generation at the LHC era workshop, Geneva, Switzerland, 4-5 Sep 2008; PMC Phys. A 
3, 4, 2009: larXiv:0904.4698l [hep-ph], 

[14] M. Sahin, S. Sultansoy and S. Turkoz, Searching for the fourth Family quarks through anoma- 
lous decays, Phys. Rev. D 82, 051503(R) (2010): laTXTv: 1005.45381 [hep-ph], 

[15] A. Datta and S. Raychaudhuri, Quark masses and mixing angles in a four generation model 
with a naturally heavy neutrino, Phys. Rev. D 49, 4762 (1994). 

[16] S. Atag et al., The Fourth SM Family, breaking of mass democracy and the CKM mixings, 
Phys. Rev. D 54, 5745 (1996). 

[17] A.K. Ciftci, R. Ciftci and S. Sultansoy, The Fourth SM family neutrino at future linear colliders, 
Phys. Rev. D 72, 053006 (2005). 

[18] J. Erler and P. Langacker, Precision Constraints on Extra Fermion Generations, Phys. Rev. 

26 



Lett. 105, 031801 (2010). 
[19] M. Maltoni et al., Extra quark lepton generations and precision measurements, Phys. Lett. B 



476, 107 (2000); arXiv:hep-ph/9911535 



[20] H.-J. He, N. Polonsky and S. Su, Extra families, Higgs spectrum and oblique corrections, Phys. 



Rev. D 64, 053004 (2001); |a7Xiv:hep-ph/0102144] 



[21] J. Alwall et al, "Is V(tb) ±2 1?", Eur. Phys. J. C 49, 791 (2007); |a7Xw:hep-ph/0607Tl5 



[22] G. Kribs et al., Four generations and Higgs physics, Phys. Rev. D 76, 075016 (2007); 

larXiv:0706.37T8l [hep-ph]. 
[23] M. Bobrowski et al., "How Much Space Is Left For A New Family Of Fermions?," Phys. Rev. 

D 79 113006 (2009): la7XTv:0902.4883l [hep-ph], 
[24] M. S. Chanowitz, "Bounding CKM Mixing with a Fourth Family," Phys. Rev. D 79, 113008 

(2009) ; larXiv:0904.3570l [hep-ph] . 
[25] M. Hashimoto, "Constraints on mass spectrum of fourth generation fermions and Higgs bosons", 

Phys. Rev. D 81, 075023 (2010) larXiv:1001.43351 
[26] O. Ebberhardt, A. Lenz and J. Rohrwild, Less space for a new family of fermions, 

larXiv: 1005.3505 . 2010. [1-5]. 
[27] O. Cobanoglu et al, OPUCEM: A Library with Error Checking Mechanism for Computing 

Oblique Parameters, arXiv: 1005.2784 [hep-ex]. 



[28] http:/ /projects. hepforge.org/opucem/ 



[29] E. Arik et al, Enhancement of Standard Model Higgs Boson Production Cross-section with 

the 4 th Standard Model Family Quarks, ATL-PHYS-98-125, (1998). 
[30] ATLAS collaboration, ATLAS detector and physics performance technical design report, 

CERN-LHCC-99-14/15 (1999), see section 18.2. 
[31] I.F. Ginzburg, LP. Ivanov and A. Schiller, Search for fourth generation quarks and leptons at 

the Fermilab Tevatron and CERN Large Hadron Collider, Phys. Rev. D 60, 095001 (1999); 



arXiv:hep-ph/9802364 



[32] E. Arik et al., Consequences of extra SM families on the Higgs boson production at Tevatron 



and LHC, Phys. Rev. D 66, 033003 (2002); arXiv:hep-ph/0203257 



[33] E. Arik et al., Can the Higgs boson be discovered at the LHC with integrated luMINOSity of 



order fb' 1 ?, Eur. Phys. J. C 26, 9 (2002); [a7xTv:hep-ph/0109037 



[34] O. Cakir and S. Sultansoy, The Fourth SM family enhancement to the golden mode at the 

27 



upgraded Tevatron, Phys. Rev. D 65, 013009 (2002); |arXiv:hep-ph/0106312 



[35] E. Arik et al., Observability of Higgs boson and extra SM families at Tevatron, Acta Phys. 



Polon. B 37, 2839 (2006); arXiv:hep-ph/0502050 



[36] E. Arik, S. A. Cetin and S. Sultansoy, The impact of the fourth SM family on the Higgs 
observability at the LHC, Balk. Phys. Lett. 15, 1 (2007); l arXiv:0708.0"24T1 [hep-ph]. 

[37] N.Becerici Schmidt et al, The fourth Standard Model family and the competition in Stan- 
dard Model Higgs boson search at Tevatron and LHC, Eur. Phys. J. C 66, 119 (2010); 
larXiv:0908.2653l [hep-ph]. 

[38] T. Aaltonen et al. (CDF Coloboration and DO Coloboration) , Combined Tevatron upper limit 
on gg -> H -> W~+W~- and constraints on the Higgs boson mass in fourth-generation fermion 



models, Phys. Rev. D 82, 011102(R) f 20101: laTXiv: 1005.3 216 [hep-ex]. 

[39] S. Sultansoy and G. Unel, 'Silver' mode for the heavy Higgs search in the presence of a fourth 
SM family, Turk. J. Phys. 31, 295 (2007): llarXiv:0707.3266l [hep-ph]. 

[40] T. Cuhadar-Donszelmann et al., Fourth family neutrinos and the Higgs boson at the LHC, 
JHEP 10, 074 (2008): IaTXTv:0806.4003l [hep-ph], 

[41] A. Rajaraman and D. Whiteson, Tevatron Discovery Potential for Fourth Generation Neutri- 
nos: Dirac, Majorana and Everything in Between. larXiv: 1 005.4407 [hep-ph]. 

[42] S. Sultansoy, Linac ring type colliders: Second way to TeV scale, Presented at International 
Europhysics Conference on High-Energy Physics (HEP 2003); Aachen, Germany, 17-23 Jul 



2003. Eur. Phys. J. C 33, S1064 (2004); arXiv:hep-ex/0306034 



[43] S. Sultansoy, A Review of TeV scale lepton-hadron and photon-hadron colliders, Proceedings 
of Particle Accelerator Conference (PAC 05), Knoxville, Tennessee, 16-20 May 2005, pp 4329. 



arXiv:hep-ex/0508020 



[44] E. Arik et al, Search for the fourth family up quarks at CERN LHC, Phys. Rev. D 58, 117701 
(1998). 

[45] M. Sher, Fourth generation b-prime decays into b + Higgs bosons, Phys. Rev. D 61, 057303 
(2000), |arXiv:hep-ph/9908238 



[46] A.K. Ciftci, R. Ciftci, S. Sultansoy, A Search for the fourth SM family fermions and E(6) 



quarks at u mu+ mu- colliders, Phys. Rev. D 65, 055001 (2002); |arXiv:hep-ph/0106222 



[47] H. Ciftci and S. Sultansoy, New hadrons formed by the fourth SM family and iso - singlet 



quarks, Mod. Phys. Lett. A 18, 859 (2003); |aZXiv:hep-ph/0107321 

28 



[48] R. Ciftci et al, Fourth SM family manifestations at CLIC, Turk. J. Phys. 27, 179 (2003); 



|arXiv:hep-ph/0203083 

[49] E. Arik et al., Fourth generation pseudoscalar quarkonium production and observability at 



hadron colliders, Phys. Rev. D 66, 116006 (2002); arXiv hep-ph/0208169 



[50] E. Arik, O. Cakir and S. Sultansoy, Has the anomalous single production of the fourth SM 



family quarks decaying into light Higgs boson been observed by CDF?, arXiv:hep-ph/0208099 



[51] E. Arik, O. Cakir and S. Sultansoy, Anomalous single production of the fourth SM family 



quarks at Tevatron., Phys. Rev. D 67, 035002 (2003); |arXiv:hep-ph/0208033[ 
[52] Y. Islamzade, H. Karadeniz, S. Sultansoy, Anomalous single production of the fourth SM 



family quarks and leptons at future electron positron colliders; arXiv:hep-ex/0208003 



[53] E. Arik, O. Cakir and S. Sultansoy, A Search for the fourth SM family quarks at the Tevatron, 
Eur. Phys. J. C 39, 499 (2005) }a?Xi7:hep-ph/0308T70 



[54] E. Arik, O. Cakir and S. Sultansoy, Search for anomalous single production of the 
fourth SM family quark decaying into a light scalar, Europhys. Lett. 62, 332 (2003); 



arXiv:hep-ph/0309041 



[55] E. Accomando et al., Physics at the CLIC multi-TeV linear collider. By CLIC Physics Working 
Group CERN-2004-005 (2004); |a7xTv: hep-ph/ 04 12251 



[56] A.K. Ciftci, R. Ciftci and S. Sultansoy, The Fourth SM family neutrino at future linear colliders, 



Published in Phys. Rev. D 72, 053006 (2005); arXiv:hep-ph/0505120 



[57] A.K. Ciftci et al, Anomalous single production of the fourth generation charged leptons at 



future ep colliders, Mod. Phys. Lett. A 23, 1047 (2008); arXiv:hep-ph/0612215 



[58] B. Holdom, t-prime at the LHC: The Physics of discovery, JHEP 0703, 063 (2007); 



arXiv:hep-ph/0702037 



[59] B. Holdom, The heavy quark search at the LHC, JHEP 0708, 069 (2007); 

larXiv:0705. 17361 [hep-ph]. 
[60] P.Q. Hung and M. Slier, Experimental constraints on fourth generation quark masses, Phys. 

Rev. D 77, 037302 f2008): larXiv:071 1.43531 [hep-ph], 
[61] A.K. Ciftci, R. Ciftci and S. Sultansoy, Anomalous Single Production of the Fourth Generation 

Neutrino at Future ep Colliders, Phys. Lett. B 660, 534 f2008): [arXiv:0711.4153l [hep-ph], 
[62] A. K. Ciftci et al., Single anomalous production of the fourth SM family quarks at future ee, 

ep, and pp colliders, AIP Conf. Proc. 899, 227 (2007). 



29 



[63] A.K. Ciftci et al., Single anomalous production of the fourth SM family leptons at future ee, 

ep and pp colliders, AIP Conf. Proc. 899, 191 (2007). 
[64] V.E. Ozcan, S. Sultansoy and G. Unel, Prospects for the discovery of 4th family quarks with 

the ATLAS detector, Eur. Phys. J. C 57, 621 (2008). 
[65] Q. F. del Aguila et al., Collider aspects of flavour physics at high, Report of Working Group 

1 of the CERN Workshop Flavor in the Era of the LHC, Eur. Phys. J. C 57, 183 (2008); 

larXiv:0801.1800l [hep-ph]. 
[66] O. Cakir et al, Single Production of Fourth Family Quarks at the LHC, Eur. Phys. J. C 56, 

537 ( 2008k larXiv:0801.0236l [hep-ph]. 
[67] V.E. Ozcan, S. Sultansoy and G. Unel, Search for 4th family quarks with the ATLAS detector, 

ATL-PHYS-PUB-2007-018 ; larXiv:0802.262T1 [hep-ex]. 
[68] E. De Pree, M. Sher and I. Turan, Production of single heavy charged leptons at a linear 

collider, Phys. Rev. D 77, 093001 (2008): arXiv:0803.0996l [hep-ph], 
[69] R. Ciftci, Anomalous Single Production of the Fourth Generation Quarks at the LHC, Phys. 

Rev. D 78, 075018 (2008): la7Xiv:0807.4291l [hep-ph], 
[70] V.E. Ozcan, S. Sultansoy and G. Unel, Hints from Tevatron, a prelude to what?; 

larXiv:0808.0285l [hep-ph]. 
[71] R. Ciftci, A.K. Ciftci and S. Sultansoy, Possible Single Resonant Production of the Fourth 

Generation Charged Leptons at gamma e Colliders, Europhys. Lett. 90, 41001 (2010); 

larXiv:0902.2800l [hep-ph]. 
[72] R. Ciftci and A.K. Ciftci, A Comperative Study of the Anomalous Single Production of the 

Fourth Generation Quarks at ep and gamma p Colliders, arXiv:0904.4489 [hep-ph]. 
[73] V.E. Ozcan, S. Sultansoy and G. Unel, Possible Discovery Channel for New Charged Leptons 

at the LHC, J. Phys. G 36, 095002 (2009). la7Xiv:0903.3177l [hep-ex], 
[74] O. Cakir, A. Senol and A.T. Tasci, Single Production of Fourth Family t-prime Quarks at 

LHeC, Europhys. Lett. 88, 11002 (2009); arXiv:0905.4347l [hep-ph], 
[75] I.T. Cakir et al., Anomalous resonant production of the fourth family up type quarks at the 

LHC, Phys. Rev. D 80, 095009 (2009): la7Xiv:0908.0123l [hep-ph], 
[76] O. Cakir and V. Cetinkaya, Single Production of Fourth Family b' Quark at the Large Hadron 

electron Collider, e-Print: llarXiv:0912.2041l [hep-ph], 
[77] A. Rajaraman and D. Whiteson, Discovering Majorana neutrinos produced via a Z boson at 



30 



hadron colliders, Phys. Rev. D 81, 071301 (2010): larXTv:1001.1229l [hep-ph]. 

B. Holdom and Qi-Shu Yan, The b' search at the LHC, larXiv:1004.303~Tl [hep-ph]. 

|http:/ / www.nu.to. infn.it/Fourth_Generation/ 



https: / /fourth-family, web. cern.ch/fourth-family/Fourth_Family/Intro. html. 

N. Cabibbo, L. Maiani and Y. Srivastava, Phys. Lett. B 139, 459 (1984). 

K. Hagiwara, S. Komamiya and D. Zeppenfeld, Z. Phys. C - Particles and Fields 29, 

(1985). 



A. Pukhov et al, arXiv:hep-ph/9908288, 



J. Pumplin et al, JHEP 0207, 12 (2002); D. Stump et al, JHEP 0310, 046 (2003). 

J. Alwall et al, J. High Energy Phys. 09, (2007) 028. 

G.L. Bayatian et al. (CMS Collaboration), J. Phys. G 34, 995 (2007). 



31 



